Pandas Profiling Report

Dataset statistics

Number of variables	9
Number of observations	2178088
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	116.3 MiB
Average record size in memory	56.0 B

Variable types

NUM	8
CAT	1

Warnings

`Valeur fonciere` is highly skewed (γ1 = 102.6400225)	Skewed
`Surface reelle bati` is highly skewed (γ1 = 209.2974261)	Skewed
`Surface terrain` is highly skewed (γ1 = 35.74357122)	Skewed
`df_index` has unique values	Unique
`Surface reelle bati` has 1271835 (58.4%) zeros	Zeros
`Nombre pieces principales` has 1359371 (62.4%) zeros	Zeros
`Surface terrain` has 589383 (27.1%) zeros	Zeros

Reproduction

Analysis started	2020-10-22 01:52:28.073573
Analysis finished	2020-10-22 01:57:56.755825
Duration	5 minutes and 28.68 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	2178088
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1192718.357
Minimum	0
Maximum	2407040
Zeros	1
Zeros (%)	< 0.1%
Memory size	16.6 MiB

Quantile statistics

Minimum	0
5-th percentile	120277.35
Q1	599915.75
median	1200638.5
Q3	1780231.25
95-th percentile	2268533.65
Maximum	2407040
Range	2407040
Interquartile range (IQR)	1180315.5

Descriptive statistics

Standard deviation	688239.2687
Coefficient of variation (CV)	0.5770341879
Kurtosis	-1.179442915
Mean	1192718.357
Median Absolute Deviation (MAD)	587222.5
Skewness	-0.009760212173
Sum	2.597845541e+12
Variance	4.73673291e+11
Monotocity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2047	1	< 0.1%
2150067	1	< 0.1%
2129573	1	< 0.1%
2123430	1	< 0.1%
2125479	1	< 0.1%
2102952	1	< 0.1%
2105001	1	< 0.1%
2098858	1	< 0.1%
2100907	1	< 0.1%
2111148	1	< 0.1%
Other values (2178078)	2178078	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%

Value	Count	Frequency (%)
2407040	1	< 0.1%
2407039	1	< 0.1%
2407038	1	< 0.1%
2407037	1	< 0.1%
2407036	1	< 0.1%

Nature mutation
Categorical

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	16.6 MiB

Vente	2115098
Vente en l'état futur d'achèvement	26753
Echange	23993
Vente terrain à bâtir	7493
Adjudication	4315

Frequencies
Length

Value	Count	Frequency (%)
Vente	2115098	97.1%
Vente en l'état futur d'achèvement	26753	1.2%
Echange	23993	1.1%
Vente terrain à bâtir	7493	0.3%
Adjudication	4315	0.2%
Expropriation	436	< 0.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	34
Median length	5
Mean length	5.448744036
Min length	5

Code type local
Real number (ℝ_≥0)

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	3.274960424
Minimum	1
Maximum	5
Zeros	0
Zeros (%)	0.0%
Memory size	8.3 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	3
Q3	5
95-th percentile	5
Maximum	5
Range	4
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	1.655801634
Coefficient of variation (CV)	0.505594395
Kurtosis	-1.61044209
Mean	3.274960424
Median Absolute Deviation (MAD)	2
Skewness	-0.1947858314
Sum	7133152
Variance	2.741679052
Monotocity	Not monotonic

Histogram with fixed size bins (bins=5)

Value	Count	Frequency (%)
5	921226	42.3%
1	513516	23.6%
3	346028	15.9%
2	306925	14.1%
4	90393	4.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	513516	23.6%
2	306925	14.1%
3	346028	15.9%
4	90393	4.2%
5	921226	42.3%

Value	Count	Frequency (%)
5	921226	42.3%
4	90393	4.2%
3	346028	15.9%
2	306925	14.1%
1	513516	23.6%

Valeur fonciere
Real number (ℝ_≥0)

SKEWED

Distinct	89486
Distinct (%)	4.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	569607.0484
Minimum	0.01
Maximum	2086000000
Zeros	0
Zeros (%)	0.0%
Memory size	16.6 MiB

Quantile statistics

Minimum	0.01
5-th percentile	2500
Q1	55000
median	139766
Q3	250500
95-th percentile	850000
Maximum	2086000000
Range	2086000000
Interquartile range (IQR)	195500

Descriptive statistics

Standard deviation	6047919.211
Coefficient of variation (CV)	10.61770431
Kurtosis	25137.02172
Mean	569607.0484
Median Absolute Deviation (MAD)	94384
Skewness	102.6400225
Sum	1.240654277e+12
Variance	3.657732678e+13
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
150000	19549	0.9%
100000	19519	0.9%
120000	18305	0.8%
80000	16383	0.8%
130000	16269	0.7%
110000	16085	0.7%
1	15912	0.7%
140000	15863	0.7%
200000	15429	0.7%
50000	15043	0.7%
Other values (89476)	2009731	92.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.01	2	< 0.1%
0.15	117	< 0.1%
0.16	6	< 0.1%
0.18	2	< 0.1%
0.19	2	< 0.1%

Value	Count	Frequency (%)
2086000000	2	< 0.1%
1750000000	3	< 0.1%
690186750	24	< 0.1%
612990460	6	< 0.1%
400000000	1	< 0.1%

Latitude
Real number (ℝ_≥0)

Distinct	27878
Distinct (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	46.9070795
Minimum	41.43549874
Maximum	51.07304369
Zeros	0
Zeros (%)	0.0%
Memory size	16.6 MiB

Quantile statistics

Minimum	41.43549874
5-th percentile	43.40267912
Q1	45.00720159
median	47.26511299
Q3	48.70588802
95-th percentile	50.37764601
Maximum	51.07304369
Range	9.637544944
Interquartile range (IQR)	3.698686423

Descriptive statistics

Standard deviation	2.159481633
Coefficient of variation (CV)	0.04603743519
Kurtosis	-1.050324024
Mean	46.9070795
Median Absolute Deviation (MAD)	1.618849978
Skewness	-0.1970060188
Sum	102167747
Variance	4.663360921
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
43.59638143	65496	3.0%
44.85724454	47690	2.2%
47.23163568	39636	1.8%
50.63171832	38695	1.8%
49.4984525	14298	0.7%
43.84493839	12578	0.6%
45.43012355	12540	0.6%
47.39863823	11844	0.5%
45.85425496	11052	0.5%
47.98852567	10030	0.5%
Other values (27868)	1914229	87.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
41.43549874	57	< 0.1%
41.50462583	20	< 0.1%
41.51630438	38	< 0.1%
41.52493194	6	< 0.1%
41.55596037	34	< 0.1%

Value	Count	Frequency (%)
51.07304369	130	< 0.1%
51.06377209	9	< 0.1%
51.04860145	58	< 0.1%
51.04797536	48	< 0.1%
51.03072291	5265	0.2%

Longitude
Real number (ℝ)

Distinct	27878
Distinct (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.605260636
Minimum	-5.085345335
Maximum	9.510244977
Zeros	0
Zeros (%)	0.0%
Memory size	16.6 MiB

Quantile statistics

Minimum	-5.085345335
5-th percentile	-2.173420587
Q1	-0.4310759606
median	1.754946717
Q3	3.100935838
95-th percentile	5.932396342
Maximum	9.510244977
Range	14.59559031
Interquartile range (IQR)	3.532011799

Descriptive statistics

Standard deviation	2.461188802
Coefficient of variation (CV)	1.533201991
Kurtosis	-0.4921641444
Mean	1.605260636
Median Absolute Deviation (MAD)	1.733703777
Skewness	0.03690341499
Sum	3496398.928
Variance	6.05745032
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1.431672934	65496	3.0%
-0.5736967812	47690	2.2%
-1.548310086	39636	1.8%
3.047832723	38695	1.8%
0.1401537192	14298	0.7%
4.34806797	12578	0.6%
4.379139971	12540	0.6%
0.6965263764	11844	0.5%
1.248757902	11052	0.5%
0.2000304935	10030	0.5%
Other values (27868)	1914229	87.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-5.085345335	49	< 0.1%
-4.764636374	111	< 0.1%
-4.762342041	97	< 0.1%
-4.75352483	90	< 0.1%
-4.733550773	69	< 0.1%

Value	Count	Frequency (%)
9.510244977	8	< 0.1%
9.473276793	1	< 0.1%
9.456903144	11	< 0.1%
9.442249582	1	< 0.1%
9.427379333	2	< 0.1%

Surface reelle bati
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct	3679
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	49.82587389
Minimum	0
Maximum	240000
Zeros	1271835
Zeros (%)	58.4%
Memory size	8.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	67
95-th percentile	144
Maximum	240000
Range	240000
Interquartile range (IQR)	67

Descriptive statistics

Standard deviation	619.9422564
Coefficient of variation (CV)	12.44217528
Kurtosis	62231.97131
Mean	49.82587389
Median Absolute Deviation (MAD)	0
Skewness	209.2974261
Sum	108525138
Variance	384328.4013
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1271835	58.4%
80	18122	0.8%
90	16883	0.8%
60	15972	0.7%
70	15193	0.7%
100	14716	0.7%
50	12847	0.6%
40	11782	0.5%
65	11138	0.5%
120	10926	0.5%
Other values (3669)	778674	35.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1271835	58.4%
1	307	< 0.1%
2	289	< 0.1%
3	214	< 0.1%
4	170	< 0.1%

Value	Count	Frequency (%)
240000	2	< 0.1%
215000	2	< 0.1%
212120	2	< 0.1%
152856	6	< 0.1%
142536	1	< 0.1%

Nombre pieces principales
Real number (ℝ_≥0)

ZEROS

Distinct	40
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.336657197
Minimum	0
Maximum	67
Zeros	1359371
Zeros (%)	62.4%
Memory size	8.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	3
95-th percentile	5
Maximum	67
Range	67
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	2.00033039
Coefficient of variation (CV)	1.496517129
Kurtosis	3.001539706
Mean	1.336657197
Median Absolute Deviation (MAD)	0
Skewness	1.398016025
Sum	2911357
Variance	4.001321671
Monotocity	Not monotonic

Histogram with fixed size bins (bins=40)

Value	Count	Frequency (%)
0	1359371	62.4%
4	196423	9.0%
3	179060	8.2%
2	137542	6.3%
5	129808	6.0%
1	89588	4.1%
6	53483	2.5%
7	20003	0.9%
8	7555	0.3%
9	2800	0.1%
Other values (30)	2455	0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1359371	62.4%
1	89588	4.1%
2	137542	6.3%
3	179060	8.2%
4	196423	9.0%

Value	Count	Frequency (%)
67	1	< 0.1%
56	1	< 0.1%
54	1	< 0.1%
53	2	< 0.1%
50	1	< 0.1%

Surface terrain
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct	39745
Distinct (%)	1.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1965.308289
Minimum	0
Maximum	1662560
Zeros	589383
Zeros (%)	27.1%
Memory size	8.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	292
Q3	1000
95-th percentile	8510
Maximum	1662560
Range	1662560
Interquartile range (IQR)	1000

Descriptive statistics

Standard deviation	8947.693457
Coefficient of variation (CV)	4.552819275
Kurtosis	3473.886753
Mean	1965.308289
Median Absolute Deviation (MAD)	292
Skewness	35.74357122
Sum	-14352896
Variance	80061218.21
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	589383	27.1%
500	31734	1.5%
1000	14221	0.7%
600	4608	0.2%
800	4536	0.2%
13	4349	0.2%
12	4343	0.2%
400	3944	0.2%
200	3816	0.2%
100	3725	0.2%
Other values (39735)	1513429	69.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	589383	27.1%
1	3561	0.2%
2	2871	0.1%
3	2499	0.1%
4	2652	0.1%

Value	Count	Frequency (%)
1662560	1	< 0.1%
1420388	1	< 0.1%
1411524	4	< 0.1%
1250223	1	< 0.1%
1187767	1	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

First rows

	df_index	Nature mutation	Code type local	Valeur fonciere	Latitude	Longitude	Surface reelle bati	Nombre pieces principales	Surface terrain
0	0	Vente	1	293000.0	48.327199	4.016432	113	5	898
1	1	Vente	1	208050.0	48.327199	4.016432	98	4	613
2	2	Vente	1	176000.0	48.327199	4.016432	79	3	610
3	3	Vente	5	176000.0	48.327199	4.016432	0	0	224
4	4	Vente	5	176000.0	48.327199	4.016432	0	0	1348
5	5	Vente	1	213400.0	48.327199	4.016432	100	4	1118
6	6	Vente	1	213400.0	48.327199	4.016432	100	4	500
7	7	Vente	1	226500.0	48.327199	4.016432	109	5	786
8	8	Vente	4	1.0	48.327199	4.016432	1121	0	5854
9	9	Vente	5	267000.0	48.327199	4.016432	0	0	160

Last rows

	df_index	Nature mutation	Code type local	Valeur fonciere	Latitude	Longitude	Surface reelle bati	Nombre pieces principales	Surface terrain
2178078	2407031	Vente	4	27200000.0	48.867903	2.344107	104	0	354
2178079	2407032	Vente	4	27200000.0	48.867903	2.344107	253	0	354
2178080	2407033	Vente	2	27200000.0	48.867903	2.344107	20	2	354
2178081	2407034	Vente	4	27200000.0	48.867903	2.344107	238	0	354
2178082	2407035	Vente	4	27200000.0	48.867903	2.344107	22	0	354
2178083	2407036	Vente	4	27200000.0	48.867903	2.344107	46	0	354
2178084	2407037	Vente	4	27200000.0	48.867903	2.344107	102	0	354
2178085	2407038	Vente	4	27200000.0	48.867903	2.344107	44	0	354
2178086	2407039	Vente	4	27200000.0	48.867903	2.344107	228	0	354
2178087	2407040	Vente	2	680000.0	48.867903	2.344107	72	3	0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows